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THE  PROBLEM 

Current  a'.rcrew  selection  researcn  et torts  at  tne  Naval  Aerospace 
Medical  Research  Laboratory  have  focused  primarily  on  the  measurement  of 
psychomotor  and  cognitive  abilities.  Evidence  from  studies  or  flight 
training  attrition  suggests  that  a  number  of  failures  may  be  attributed  to 
personality  or  motivational  factors  rather  than  a  lack  of  abilities.  Be¬ 
cause  flight  training  success  is  a  dynamic  interaction  of  abilities,  moti¬ 
vation,  and  personality  factors,  all  three  areas  should  be  included  to 
optimize  the  predictive  validity  of  aircrew  selection  batteries. 

THE  FINDINGS 

Two  sets  of  data  are  presented;  one  set  is  from  a  computer-based  risk 
assessment  task,  and  the  other  is  from  the  Jenkins  Activity  Survey.  The 
data  indicated  tew  relationships  between  rick  assessment  measures  and 
flight  training  criteria.  We  found  only  one  indication  out  of  six  that 
increased  risk-taking  was  associated  with  successrully  completing  primary 
flight  training.  Results  from  the  Jenkins  Activity  Survey  indicated  con¬ 
tradictory  relationships  between  tne  scale  measures  and  flight  training 
criteria  in  the  few  significant  findings  observed. 

RECOMMENDATIONS 

At  this  time,  we  cannot  recommend  including  either  test  in  a  naval 
aircrew  selection  battery.  We  suggest  further  research  involving  these  and 
other  personality  measurement  tools  to  evaluate  personality  tactors  and 
aircrew  selection.  Specifically,  risk  test  data  correlated  significantly 
with  the  successful  completion  of  primary  tLight  training.  This  finding 
suggests  that  a  greater  "willingness"  to  take  risks  may  be  associated  with 
success  in  primary  tlignt  training.  Continued  researcn  of  the  personality- 
pertormance  relationship  is  warranted  because  operational  aviation  selec¬ 
tion  tests  nave  an  uncorrected  predictive  validity  correlation  or 
approximately  0.15  -  0.25  to  a  pass/attrite  criterion  tor  primary  flight 
training,  which  leaves  a  considerable  amount  (75%)  of  variance  unaccounted 
for. 
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INTRODUCTION 


An  increase  in  the  number  of  U.S.  Navy  aircraft  has  resulted  in  a 
constant,  it  not  escalating,  demand  for  aviators.  The  high  cost  of  train¬ 
ing  aviators  on  sophisticated  aircraft  underscores  the  importance  of  appro¬ 
priate  selection  procedures  that  permit  early  and  accurate  identitica tion 
of  potentially  successful  aviation  candidates.  Ideally,  selected  candi¬ 
dates  will  complete  the  required  flight  training  coursen  from  primary 
flight  training  to  operational  certification.  Every  selectee  for  aircrew 
training  who  fails  to  complete  primary  flight  training  contributes  to  a 
possible  operational  manpower  shortage  if  expected  replacements  necessary 
to  maintain  military  readiness  do  not  materialize  on  schedule.  A  highly 
desirable  alternative  is  to  minimize  attrition  rates  by  identifying  and 
selecting  only  those  candiiates  with  the  potertiaL  to  succeed  la  the  avia¬ 
tion  environment. 

Current  aircrew  selection  research  efforts  at  the  Naval  Aerospace 
Medical  Research  Laboratory  (NAMRL)  have  focused  primarily  on  the  evalua¬ 
tion  of  candidates'  psychomotor  and  cognitive  abilities.  While  these 
abilities  are  necessary  for  successful  pe  formance  in  primary  flight  train¬ 
ing,  e  number  of  failures  may  be  attribute  le  to  personality  and/or  motiva¬ 
tional  factors  (1),  Helmreich  (1)  contends  that  flight  ability  must  be 
regarded  as  a  dynamic  interaction  of  sensory-motor  skills  and  personality 
characteristics.  Perhaps  certain  personality  characteristics  or  types  do 
correlate  witn  success  in  primary  flight  training,  such  that  assessment  of 
these  would  contribute  significantly  to  the  prediction  of  flight  training 
performance.  Personality  tests  have  behh  used  to  hire  airline  pilots  and 
executives  in  private  industry  as  well  as  to  'elect  military  pilots  in 
foreign  countries  (2,3).  There  is  no  reason  to  assume  that  personality 
testing  will  not  improve  the  aircrew  selection  process  and  many  reasons  to 
assume  that  It  will.  Nevertheless,  a  paucity  of  research  deals  with  per¬ 
sonality  tests  as  part  of  aircrew  selection  efforts. 

We  hypothesized  that  willingness  to  take  risks  might  contribute  to 
success  in  flight  training  and  that  individuals  with  fewer  Type-A  traits 
would  be  more  likely  to  fail  primary  flight  training.  With  this  in  mind, 
we  Investigated  two  personality  instruments:  the  NAMRL  automated  risic 
assessment  teat  (A)  and  the  Jenkins  Activity  Survey  Forin-C  (JAS-C)  (5). 
Subjects'  scores  on  tnese  tests  were  also  compared  to  their  scores  on  the 
current  U.S.  Navy/ Marine  r.via  tic;:  selection  test  battery  (Academic 
Qualifications  Test/Flight  Aptitude  Rating)  to  assess  the  relationship 
between  the  various  measures  of  flight  training  performance. 


METHOD 

SUBJECTS 

Student  naval  aviators  (SNAs)  participated  as  volunteer  subjects  tor 
both  casts.  The  risk  test  was  administered  to  440  SNAs  (433  males,  7 
females).  The  JAS-C  was  administered  to  158  SNAs  (155  males,  3  females); 
108  of  these  also  took  the  risk  test.  For  both  tests,  the  subject  age 
range  was  20-29  years  (  M.  =  23.21,  _SD.  =  1.52  tor  the  risk  test;  JM  ->  23.31, 
SP  “  1.56  for  the  JAS-C).  Before  testing,  all  subjects  were  informed  that 
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test  results  would  not  atfect  their  continuation  in  the  tlight  program  and 
would  not  he  entered  into  their  service  record. 

APPARATUS 

The  risk  test  was  conducted  using  an  Apple  lie  microcomputer  system 
with  an  Amdek  Color  I  Plus  monitor  and  an  Apple  lie  numeric  keypad  placed 
under  the  subject's  right  hand.  The  JAS-C  was  administered  as  a  standard 
paper-nnd-pencil  test. 

TESTS 

NAMRL  Automated  Risk  Assessment  Test 


The  risk  test  is  a  gambling  task  that  was  developed  from  a  test  de¬ 
scribed  by  Slovic  (6),  An  initial  version  of  this  test  was  first  outlined 
;jy  Imhotf  &  Levine  (7)  and  subsequently  revised  by  Dclgin  et  al,  (4). 
Decision  making  is  one  of  the  processes  most  widely  cited  as  critical  to 
piloting*  and  a  tendency  to  take  risks  is  considered  to  be  one  ot  the 
primary  components  ot  that  attribute  (7).  The  level  of  risk  is  typically 
measured  by  1)  the  individual's  willingness  to  accept  a  given  level  ot 
probability  to  obtain  a  payoff,  and  2)  the  time  required  to  make  such  a 
response.  Time -re la  ted  measures  of  risk-taking  may  be  important  because 
piloting  involves  decisions  that  are  often  made  under  time  constraints  (7). 

The  risk  test  consisted  ot  3  sessions  ot  10  trials  eacn.  For  each 
trial  In  Session  1,  the  subject  viewed  a  matrix  of  squares  identified  by 
numbers.  At  the  beginning  ot  each  trial,  one  square  was  a  penalty  square 
(PS),  and  nine  we. .9  reward  squares  (RS)  that  were  selected  by  pressing  a 
key  corresponding  to  the  number  in  the  square.  The  subject  could  select 
any  of  the  squares,  one  at  a  time,  and  if  the  selected  squares  contained  a 
payoff,  the  subject  retained  it.  If  a  subject  first  selected  a  RS  and  then 
selected  a  second  square,  the  probability  of  getting  the  PS  was  then  1  out 
of  8,  and  so  forth.  The  probability  of  selecting  the  PS  increased  on  each 
successive  response  as  the  number  of  RS  available  for  selection  decreased. 
It  the  subject  selected  the  PS,  the  trial  ended,  and  all  points  tor  that 
trial  were  lost.  Thus,  in  any  given  trial,  a  subject  could  acquire  a 
maximum  ot  nina  RS  during  each  trial.  Subjects  could  stop  at  any  time 
during  a  trial.  For  example,  it  a  subject  acquired  three  P.S,  the  subject 
could  stop  and  keep  the  total  points  tor  those  three  RS.  At  that  point,  a 
new  matrix  of  10  squares  would  be  presented,  and  the  subject  would  begin 
again.  The  PS  was  randomly  reassigned  at  the  beginning  ot  each  trial. 

During  Session  2,  10  trials  were  again  presented  but  differed  from 
Session  1  in  tnat  the  sessions  were  run  with  2  randomly  assigned  PS  for 
each  trial.  Session  3  consisted  of  10  standard  trials  with  1  randomly 
assigned  PS  identical  to  the  first  session.  This  provided  an  opportunity 
to  determine  whether  respondents  were  able  to  adjust  their  strategy  accord¬ 
ing  to  risk.  The  average  number  of  squares  selected  per  trial  and  the 
average  latency  between  choices  were  calculated  and  retained  tor  eacn 
session/subject  pair.  The  test  (all  three  sessions)  was  self-paced  and 
usually  lasted  about  15  min  with  no  practice  trials.  The  final  scores  for 
analysis  were  tne  number  of  responses  (NR)  made  (based  on  the  number  ot 
squares  accumulated)  sad  the  corresponding  response  times  (RT)  for  all 
responses  during  the  session.  The  total  number  ot  points  was  the  number  ot 
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KS  chosen.  Increased  risk-taking  on  this  test  was  represented  by  increases 
in  the  number  of  responses  made  and/or  decreases  in  response  times. 

JAS-C 

The  JAS-C  is  a  52-item  multiple-choice  questionnaire  that  measures  the 
Type-A  behavior  pattern  and  three  other  related  factors:  speed  and  impa¬ 
tience,  job  involvement,  and  competitiveness  (5).  Pred  and  colleagues  (8) 
recently  derived  new  measures  from  the  JAS-C  that  consisted  of  two  moder¬ 
ately  correlated  scales  labeled  "achievement  striving"  and  "impatience/ 
irritability."  Achievement  striving  involves  goal-oriented  behavior  and  is 
positively  correlated  with  the  Work  and  Family  Orientation  Questionnaire 
(9).  Of  particular  interest  is  the  fact  that  high  achievement  striving,  is 
associated  with  superior  aircrew  performance  and  appears  to  nave  no  nega¬ 
tive  health  implications  (10).  Conversely,  high  impatience/irritability  is 
associated  with  both  negative  nealth  conditions  (i.e,,  fatigue,  sleep 
disturbance)  and  inferior  flying  performance  as  measured  in  commercial  jet 
transport  pilots  (10). 

Of  the  four  scores  derived  from  this  test,  the  Type-A  score  (A  scale) 
is  an  overall  estimate  of  tne  behavior  pattern  that  is  characterized  by 
extremes  of  competitiveness,  aggressiveness,  impatience,  and  time  pressure. 
The  speed  and  impatience  factor  (S  scale)  deals  with  time  urgency,  with 
high  scorers  tending  toward  impatience,  irritation,  and  strong  tempers. 

The  job  involvement  factor  (J  scale)  reflects  the  degree  of  occupational 
dedication,  with  high  scorers  showing  propensity  tor  challenging  high- 
pressure  jobs  to  which  they  are  very  committed.  The  hard-driving  and 
competitive  factor  (H  scale)  Involves  tne  perception  of  one's  self  as  being 
more  driven  and  competitive  than  others,  with  high  scorers  being  more 
achievement-oriented,  conscientious,  aad  eaergetic  (5).  For  each  item  that 
contributes  to  a  scale  score,  each  response  alternative  is  assigned  numeri¬ 
cal  points  based  on  the  product  of  the  item  regression  weight  and  the 
optimal  scaling  weight,  tor  that  response.  This  self-paced  test  usually 
took  approximately  20  min  to  -\omplete. 

Academic  Qualification  Test/Flight  Aptitude  Rating  (AQT/FAR) 

Tne  AQT/FAR  is  the  U.S.  Navy/ Marine  Corps  aviation  officer  selection 
test  battery.  It  is  used  as  the  primary  non-medical  instrument  tor  screen¬ 
ing  flight  training  applicants.  The  test  battery  is  composed  of  tour 
multiple  choice  tests;  the  Academic  Qualification  Test  (AQT),  Mechanical 
Comprehension  Test  (MCT),  Spatial  Apperception  Test  (SAT),  and  Biographical 
Inventory  (Bl).  The  AQT  is  a  single  test  that  measures  such  attributes  as 
generaL  intelligence,  verbal  and  quantitative  abilities,  clerical  skills, 
and  situational  judgment.  Tne  FAR  is  a  combination  of  the  MCT,  SAT,  and  31 
tests.  The  MCT  assesses  mechanical  aptitude  and  the  ability  to  perceive 
physical  relationships.  The  SAT  is  a  measure  of  spatial  orientation  that 
involves  determining  the  angle  of  bank  at  which  various  aircraft  are  con¬ 
figured.  The  BI  includes  personal  history,  interests,  and  attitudes; 
assesses  acquired  avLation  knowledge;  aad  is  the  only  untimed  test. 
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RESULTS  AND  DISCUSSION 


RISK  TEST 

Complete  AQT/FAR  scores  were  obtained  for  all  440  flight  students  who 
took  the  risk  test.  The  means  and  standard  deviations  (SDs)  of  the  AQT/FAR 
stanine  scores  and  the  scores  obtained  on  the  risk  test,  with  their  inter¬ 
correlations,  are  shown  in  Table  1.  None  of  these  correlations  proved 
significant.  For  all  tables,  significance  levels  were  adjusted  to  account 
for  multiple  comparisons  between  correlation  coefficients. 


TABLE  1.  Intercorrelations  of  the  Selection  Test  and  Risk  Test 
Scores  *  440).* 


Session 

AQT 

FAR 

SAT 

MCT 

BI 

Mean  score 

SD 

Sl-RT 

-.026 

-.074 

-.029 

-.105 

-.053 

3.58 

1.39 

S2-RT 

.017 

.015 

.019 

-.049 

.039 

2.49 

1.02 

S3-RT 

-.015 

-.062 

-.015 

-.101 

-.043 

2.25 

0.85 

Sl-KR 

.009 

.043 

.061 

-.010 

4.76 

0. 95 

S2-NR 

.052 

.017 

.038 

.024 

3.22 

0.64 

S3-NR 

.011 

-.002 

.032 

-.019 

mm 

4.87 

0.88 

Mean  score 

5.73 

7.13 

12.78 

11.73 

13.26 

SO 

1.30 

.1.58 

3.16 

2.77 

3.22 

*S1  “  first 

session 

;  S2  - 

second 

session; 

S3  “  third  session; 

RT  =  reaction  time;  NR  =•  number  of  responses. 


Of  the  440  flight  students,  2i7  completed  or  tailed  primary  flight  train¬ 
ing.  The  correlations  between  their  risk  test  scores  and  the  pass/tail  index 
(1  “  pass,  2  *  tail)  are  shown  in  Table  2.  The  correlation  between  the 
number  of  responses  during  Session  1  and  tne  pass/fail  index  (r  =*  -.184)  was 
significant.  The  direction  of  the  correlation  indicates  that  greater  risk 
taking  is  associated  with  completing  primary  flignt  training,  but  because  the 
correlation  is  small  and  not  significant  when  the  session  was  repeated  (S3- 
NR)  we.  do  not  inter  much  from  this  one  finding.  Tnis  correlation  may  be  due 
to:  1)  chance  alone;  2)  subjects  being  unaware  that  only  one  PS  was  present 

during  tne  tnird  session  trials,  and  thus,  they  responded  under  two  PS  condi¬ 
tion*  (increased  risk)  as  in  Session  2;  or  3)  risk  taking  behavior  predicts 
flight  performance  only  under  low  risk  conditions  as  in  Session  1.  On  the 
other  hand,  all  RT  correlations  were  positive  even  though  not  significant. 
This  indicates  no  relationship  between  increased  risk  taking  and  the 
pass/fail  index. 
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TABLE  2.  Intercorrela ttcns  ot  Che  Risk.  Test  Scores  and 


Pass/ Fail 

Index  (n 

«=  217).* 

Index 

Sl-RT 

S2-RT 

S3-RT  Sl-NR  S2-MR 

S3 -NR 

Pass/Fail 

.092 

,131 

.011  -.184**  -.064 

-.023 

*RT  =  reaction  time;  NR  -  number  of  responses. 
**Above  critical  value  (2-tail,  .05  level). 


None  of  the  correlations  between  the  risk  test  scores  and  grades 
received  during  preflight  and  flight  training  tor  those  who  successfully 
completed  primary  flight  training  was  significant  (Table  3). 


TABLE  3.  Intercorrelations  ot  the  RisK  Test  Scores  and  Primary  Training 
Grades  (n  ■=  197).* 


Grades 

Sl-RT 

S2-RT 

S3-RT 

Sl-NR 

S2-VR 

S3-NR 

Mean  score 

SD 

A I 

-.064 

-.053 

-.053 

-.122 

-.021 

.046 

54.48 

4.83 

ACAD 

-.065 

-.139 

-.090 

-.008 

-.057 

.125 

52.87 

10.09 

FLT-GRD 

-.112 

-.031 

-.108 

-.122 

-.020 

-.040 

3.05 

0.03 

*S1  =  first  session;  S2  *  second  session;  S3  =  third  session; 

UT  =>  reaction  time;  NR  «  number  ot  squares  accumulated; 

AI  »  initial  aviation  ground  school;  ACAD  =  academic  performance  in  primary 
flight  training;  FLT-GRD  =  primary  flight  training  grades. 

JAS-C 

Table  4  shows  the  correlations  ot  the  selection  test  stanine  scores  and 
tne  JAS-C  scores.  The  direction  of  the  significant  correlation  between  tne 
MCT  ana  tne  il  scale  indicates  toat  higher  tiCT  scores  are  associated  with 
decreuhed  competitiveness.  No  signif leant  corre la tions  were  found  between 
the  JAS-C  scores  and  either  the  pass/ tail  index  or  primary  flight  training 
grades  as  indicated  in  Tables  5  and  6.  On  the  S  and  H  scales,  our  subjects' 
scores  were  similar  to  those  ot  a  reference  population,  ages  48-65,  tnat  was 
compiled  by  the  testing  service  marketing  the  JAS-C.  Although  the  Navy 
subjects  scored  higher  on  the  A  (70th  percentile)  and  J  (86th  percentile) 
scales,  indicating  a  possible  difference  in  Type  A-behavior,  no  evidence  was 
found  to  indicate  tnis  difference  can  be  used  to  predict  flight  performance. 
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TABLE  4.  Iotercorrelations  ot  the  Selection  Test  Scores  and  the 
Jenkins  Activity  Scale  Scores  (ti  =  153). 


Scale 

AQT 

FAR 

SAT 

MCT 

BI 

Mean  score 

SD 

A 

-.044 

-.031 

-.013 

-.105 

-.029 

276.37 

60.97 

S 

.146 

.033 

-.029 

.027 

-.019 

169.72 

57.89 

J 

-.021 

-.132 

-.064 

-.119 

-.131 

284.15 

32.45 

H 

-.099 

-.118 

-.095 

-.19.* 

I 

• 

o 

u> 

123.39 

27.95 

Mean  score 

5.6a 

6.86 

12.28 

11.51 

13.04 

SD 

1.31 

1.65 

3.26 

2.97 

3.15 

*  Above  critical  value  (2- tail 

,  .05  level). 

TAB! "  , 

Intercorrelations  ot  the  Jenkins 
Activity  Scale  Scores  and  the 
Pass/FaiL  Index  (n  3  149). 

Index 

A 

Scale 

S  J  il 

Pas  8/ Fail 

-.001 

-.030  .105  .152 

TABLE  6.  Intercorrelations  of  the  Jenkins  Activity  Scale 
Scores  and  Primary  Training  Grades  (n  -  133). 


Grades 

A 

Scale 

S  J 

H 

Mean  score 

SO 

AI 

-.035 

.052 

-.135 

53.70 

5.25 

ACAD 

.088 

.150 

-.014 

.080 

50.30 

10.02 

FLT-GRD 

.039 

-.002 

-.024 

3.05 

0.03 

AI  3  initial  aviation  ground  scnool;  ACAD  3  academic  performance 
in  primary  t light  training;  FLT-GRD  =  primary  t light  training 
grades . 


CONCLUSIONS 

Of  the  two  tests  investigated,  only  the  risk  test  demonstrated  any 
relationship  to  primary  flight  training  success.  Further  research  should 
examine  the  relationship  between  the  risk  teat  and  flight  training  criteria 
under  low  risk  conditions  as  in  the  first  session  ot  the  risk  test.  The 
riak  test  should  be  reconfigured  to  include  three  sessions  ot  identical 
revels  ot  risk  (i.e.,  PS  =  1).  This  recont igura tion  would  also  permit 
assessment  ot  task  stability.  Continued  inves '"iga tion  ot  the  Jenkins 
Activity  Survey  is  not  warranted,  as  no  evidence  was  found  cor  the 
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hypothesis  tost  increased  Type-A  characteristics  lead  to  a  greater  likeli¬ 
hood  of  completing  primary  flight  training.  Due  to  the  significant  corre¬ 
lation  between  risk-taking  and  primary  flight  training  found  tor  Session  1, 
a  larger  sample  should  be  evaluated  on  the  risk  test  to  determine  if  the 
magnitude  ot  tnis  relationship  is  a  stable  one.  The  ability  to  take  risks 
is  certainly  an  important  facet  of  learning  to  fly.  The  data  presented 
here  do  not  allow  us  to  strongly  state  that  the  risk  test  scores  relate  to 
this  ability.  Given  that  the  risk  test  contains  relevant  content-validity 
and  reasonable  psychometric  properties,  continued  Investigation  is  recom¬ 
mended  . 


RECOMMENDATIONS 

At  this  time,  we  cannot  recommend  including  either  test  in  a  naval 
aircrew  selection  battery.  We  suggest  further  research  involving  these  and 
other  personality  measurement  tools  to  evaluate  personality  factors  and 
aircrew  selection.  Specifically,  risk  test  data  correlated  significantly 
with  the  successful  completion  of  primary  flight  training.  This  finding 
suggests  that  a  greater  "wiilinguess"  to  take  risks  may  be  associated  with 
success  in  primary  flight  training.  Continued  research  of  tne  personality- 
performance  relationship  is  warranted  because  operational  aviation  selec¬ 
tion  tests  have  an  uncorrected  predictive  validity  correlation  of  approxi¬ 
mately  0.15  -  0.25  to  a  pass/attrite  criterion  tor  primary  flight  training, 
wnich  leaves  a  considerable  amount  (75%)  of  variance  unaccounted  tor. 
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